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According to the latest federal guidelines^ all 
projects requesting funding must include the following program 
features: § systematic plan to eliminate existing sex hi^s and 
sex-role stercfotyping and to avoid introducing these elements, a 
third-party objective evaluation of the program's learner benefitSr 
and a strong emphasis on sex-fair gairdance^ counselingr placement r 
and followup services. Three articles that can help prepare - n 
educational leaders to deal with the federal guidelines include "The 
Role of the Responsible Leader in Developing Teacher-Prepared 
Research in Educational Technologyr" "The Role of the Responsible 
Leader in Evaluation Based Upon Counting Learner Benefits and 
••D,0*E*S.^-Decision^Oriented Evaluation Systems," According to these 
articlesr three concerns emerge for responsible leaders: programs 
should be cost-*ef fective^ programs should be modular izedr and 
programs should be tran;sportable. The responsible leader provides 
input that stresses the values of these three program attributes. A 
Decision-Oriented Bfaluation System *(D.O.E*S») locks at these three 
criteria as important yardsticks for measuring the success of any 
program. (Author/ JG) ^ 
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Required Program Features 

A quiet announcement on page 52963 of the FEDERAL REGISTER, Volume 40, 
Number 220, Thursday, November 13, 1975 has provided three specific concerns 
for responsible leaders. 

First, an 'examination of the three required program features is presented 
below. Second, an examination of t)ie three concerns for responsible leaders 
is annexed. 

Three Program Features ; 

According to the latest Federal guidelines cited 
above, the operational setting of all projects requesting 
funding must include all of the following three program 
features: 

1. A systematic plan to eliminate existing sex bias 
and sex-role stereotyping and to avoid introducing 
thesB elements into the activities undertaken with 
respect to the demonstration project, " 

2. A third-party objective evaluation, the design of 
which is an attempt to measure^ student outcomes 
against the stated objectives of the project as 
well as gather process and treatment information 
as will show reason why the project was or was not 
successful in achieving the desired outcomes for 
the designated population for student participants, 

3. A strong emphasis on sex-fair guidance, counseling, 
placement, and follow-up services, 

Impllfcations for Responsible Leaders 

Any leader who has read the following three articles is prepared for 
the above Federal guidelines: 

THE ROLE OF THE RESPONSIBLE LEADER IN DEVELOPING 
TEACHER-PREPARED RESEARCH IN EDUCATIONAL TECHNOLOGY 

THE ROLE OF THE RESPONSIBLE LEADER IN EVALUATION 
BASED UPON COUNTING LEARNER BENEFITS 

D.O.E.S. — DECISION-ORIENTED EVALUATION SYSTEMS 



' Each of these important articles can be summed up in a short paragraph 
stresssing their importance for responsible leaders making use of decision- 
oriented evaluation systems* 
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Teacher-Prepared Research 

The role of the responsible leader Is to identify competencies in other 
members of the team in such a way as to delegate highly specialized tasks 
appropriately. In addition to choosing the right person for the right job, 
the responsible leader monitors and coordinates the worH of those specialists 
vorking on the same team for commonly agreed upon objectives. A leader as 
opposed to an authoritarian "boss" is able to be a specialist in working with ^ 
specialists both formally by authority qq^ informally by professional contacts. 
As a college or university president, the leader is able to decide what should 
be done on campus and what should be done off campus. As a school' district 
superintendent, the leader is able to decide what should be done in the district 
and what should be done outside of the distrifet. As a chief administrator of 
ft local institution, the leader is able to decide what should be done by available sta: 
and what should be done by outside consultants. Cogni^ively, the leader looks 
at the big picture. Practically, the leader makes a plan and sticks to it. 
Affectively, the leader continuously gathers information that can lead to serious 
and deliberate revisions of the plan, even though the plan will not be changed 
until "next" year. For example, teacher-pVepared research is an example of one 
way the leader can multiply personal effectiveness through teamwork. 

Counting Learner Benefits 

M 

Semant^ically speaking, the term learner benefits is acceptable. Practically 
speaking, there is hardly any excuse to explain the absence of student benefits 
that an experienced and responsible leader hasn't heard. This leads many leaders 
to conclude that you only get what you expect if you inspect what people are 
doing to give what you expect. For example, when the desired expectatiojL is 
learner benefits, the best way to achieve this success is to stick to the learner 
benefit plan and inspect learner benefits frequently. The almost magical results 
of success followii^ frequent inquiries foi? evidence of this specific ob1|^ctive are 
not based upon magic, but upon sound leadership psychology. The leader *o has 
enough discipline to aim at one target long enough to achieve results and enough 
creativity to search for documentation of results in a variety of sources is in 
a position to succeed where others fail. The leader that inquiries about the 
learner benefits behind every piece o'f teacher-prepared research is goUig to 
be flooded with a wide variety, of learner benefits documented from an ^qually 
extensive array of evidence. \ 

Decision-Oriented Evaluation Systems 

litolicitly, every evaluation questionnaire and every evaluation system is 
oriented toward decision-making. Explicitly, this orientation is not always 
inmediately evident to outsiders. The way to bridge the -gap between implicit 
and explicit ^ticipations is through careful delineation of which decisions 
will be made with which iliformation. As simplictic as it is, atl appropriate 
way to begiA is with a two column analysis; one column for decisions to be 
made and the other column for appropriate decision -making information. The 
next step is to go beyond such a simplictic itemization to a more profound 
analysis both of decisions to be tijade and of appropriate available sources 
of information. The responsible leader using a decision-oriented evaluation 
system is on top of most problems without having to become unnecessarily involved 
in details that are more properly the domain of staff specialists. 
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Program Feature #1 



Any systematic plan to eliminate existing sex bias and sex-stereotyping 
and to avoid introducing these elements into the activities undertaken with 
respect to a particular project or institutional policies requires careful 
consideration. 

it must be stated that obvious violations^of the law are easily idettt^lficd 
and stopped. After all^ the judi*cial process is open to public inspection; If 
a law declares a specific activity or practice illegal, the law publicly 
proclaims this decision for all to learn about, respec*f and Implement. 

Other difficulties arise from 4 principles of common sense and common 

lawJ 



Principle I : 




An individual or institution i5 innocent until proven guilty^ 

* 

Principle 2 ; 

A scrupulous and legalistic observance of the LETTER of the law 
is never accepted as an excuse for violating the SPIRIT of the law. 

. Principle 3 i ^ 

Perceptions vary from individual to individual, from group to 
group, from institution to institution, and from one geographical 
location to another. 

Principle 4 * 

. Unilateral communieationj that Is from the boss downward, i^s 
no substitute for two*-way communication and interaction between 
administration and fl^taff# 

A Faulty Model for the Elimination of Bias 

It is not unusual for an institution to send out a long and lengthy 
questionnaire to all members* This questionnaire typically asks for data, 
numbers, short* answers, identification items, credentials, personal aspirations, 
and a number ot opinions. Such questionnaires take a large amount of time to 
Ubulate. Once the tabulation Is In, the typical administrator finds out that 
only 10 to 20 percent of the data can be used for effective decision-making. 

Whenever confronted with such a mountain of undlgestlble data, the reaction 
of the typical administrator Is to call together a small committee to come up 
with a consensus. On the basis for this consensus, such things as hiring practices 
are determined. 
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For example, a recent search committee came up with the following 
decisions after surveying all the members of the institution: 

\l. The niitnber of applicants for positions should bear some 

relationship to the size of the yearly remunsration* Thus, 
the following two columns show the number of candidates 
t^quired fpr a position with a specific salary, 

Hinsiljer of ^ ' Salary for 

' Candidates Required the Position - v 

* ^, • - ' ' 

500 \ * $30,000 

250 ^ 25,000 r 

150 ' 20,000 
75 15,000 

2. All of the above candidates must submit three letters of 
reconwendation^ Any candidate who does tiot submit three 
letters of recommendation will not be considered in the 
next step of screening. 

3. No collect phone calls will, be accepted from any of the 
above candidates even when the individual making the call 
is clearly identified as one of the legal candidates with 
credentials that htve been .received by the institution, 

4» Any time an individual candidate makeSa phone call inquiry 
about the individual's candidacy or status of consideration, 
the phone call is referred to a member of the secretarial 
staff rather than treated by the members of the search 
committee* 

5. Any inquiry over the phone or by letter referring to the exact 
salary range of a position will be answered with the 
non-commital statement, "the salary is competitive," 
Under no circumstances will a specific figure be given, 

6» fhe above pools of 50Q, 250, 150, or 75 candidates will 

be reduced to 20 candidates by screening before an intensive 
scrutiny is performed by* the search committee^ 

7, The search committee will screen the preceding group of 

20 candidates down to 8 individuals who will be interviewed. 

8» The 8 individuals to be interviewed will travel to the 
interview at their own expense. 
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Ptoeram Feature #2 ^ 

Any 3rd-party objective evaluation dejsigned to measure student outcomes 
against the stated objectives as well as gather process and treatment information 
needs to show reason vhy-a particular effort was or was not successful in achieving 
the DESIRED OUTCOMES for the DESIGNATED POPULATION of student participants. 'It 
must be stated that 3rd-party evaluation is no panacea or cure^^^alU third^party ^ 
evaluation prevents the distortions that arise wtoen the same individual or groups 
is simultaneously planner, funder, initiator, performer, judge, jury, and lawyer. 

Certain principles of Scientific measurement apply to all evaluation Including 
i 3rd-party observation: 

Principle 1 

■ft 

Measurable process objectives must be developed* 

Principle 2 _ 

A management plan must be developed which links 
these selected program priority areas and other program 
features to: 

The process objectives 

The human and financial resources to be applied 
The specific student outcome objectives anticipated 

- \ 

This linkage is necessary to provide an explanation 
for success or failure In achieving the desired STUDENT 
OUTCOMES in terms of the PROCESSES USED or RESOURCES 
APPLIED.. 

Principle 3 

In documenting learner benefits, it is necessary that 
ai3i adequate sample of young people be included in the 
evaluation so that the results may be GENERALIZED and 
PREDICTED for other COMPARABLE student populations given 
the same educational experiences* ^ 

Principle 4 

In order to translate LEARNER BENEFITS into LEARNER 
GAINS, an evaluation design must be developed that furnishes 
reasonable evidence that grains or Improvonents documented 
can be attributed to the educational and career experiences 
provided to young people and students. 

This means isolating out other factors Impacting on the 
learners at the same time* Among these other factors, 
attention should be given to: 
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Normal maturation 
Regular educational processes 
Media exposure 
Previous year's scores 
Previous yearns gains 
National norms 
Hawthorne effects 
Motivational effects 
Teacher enthusiasm 
Accessible technology 



In other words , even when documented learner benefits 
are present, these learner gains may be due to other sources 
than, those allegedly cited* 
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Program Feature #3 

A strong emphasis on sex-fair guidance, counseling, placement, and/ 
follow-up services is an integral part of any wrthwhile educational 
endeavor # 

It must. be stated that group consensus among a group of faculty 
members is incomplete unless such consensus has been achieved in light 
of* existing legal decisions, cases under litigation, and commonly accepted 
guidelines of equal opportunity and affirmative action, 

A few easy to understand, but sometimes difficult to apply principles 
of career development can be recalled here: 



Principle 1 

Both GRADUATES and DROPOUTS should receive successful 
placement and foliowup. 

Principle 2 

Successful placement may be considered the enrollment 
and progress of the young person in: 

A CETA (Comprehensive Dnployment and 

Training Act) program 
A secondary occupational program 
A post- secondary occupatignal program 
A four-year college 

A job for which training has been provided 
Some, other situation expressed by the 
' young person as a desired goal 
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Three Concerns for Responsible Leaders ; 

According to the articles summarized on teacher-prepared research, counting 
learner benefits, and decision-oriented evaluation systems, three concerns 
emerge for responsible leaders: 

I. Programs should be cost-effective 

2» Programs should be modularized ' $ 

3, Programs should be transportable 

The responsible leader realizes that programs do not become cost-effective, 
modulariJced, or transportable if left to chance. From the very conception of 
a program, the leader provides valuable input that stresses the values of 
these thtee above mentioned program attributes. 

A cost-effective program is both possible and appealing in the 1970' s and 
its climate of slow economic growth in the mist of high inflation and high 
unemploymnet. I 



A modulaiflzed program can be Imitated in whole ot in part according to the 

ic 



individual needs of.^ifferent geographical locality. 



A transportable program can be started elsewpere without uim«cessary 
expense and time being dedicated to overcoming dijCficulties that have been 
resolved elsewhere. 



A decision oriented evaluation system (D.O.E.S.) looks at the above three 
criteria as important yardsticks with which to measure the success of any 
program. If the program can measure up to these three requirements, the 
program is ready and able to be used elsewhere for maximum learner benefit. 
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